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TECHNICAL FIELD 

25 The present invention relates generally to a computer system for tracking 

references to objects and, more particularly, to a system that encapsulates the complexities of 
tracking objects as they come up and go down. 

[30581-8002/Application.doc] 

2~ 



• ft 



BACKGROUND 



The tracking of objects in computer systems can involve very complex 
processes. The processes are complex because the number of objects may be in the 
thousands, the objects may be distributed across many different computer systems, and the 
5 objects may frequently change states. For example, a distributed system to control the 
various systems in a large building may include hundreds of computers. These computers 
may control the lighting systems, the heating systems, the elevators, and various electronic 
systems (e.g., a television and a laserdisc player). The distributed system may instantiate an 
object for each of the devices that can be controlled or that can receive input or output. For 
10 example, an object may be instantiated for each light that can be separately controlled, and 
an object may be instantiated for each light switch. The number of such devices in a large 
building can be very large. 

fly, S> Su$h large distributed systems need to ensure that they can function even when 
'portions of the sysifem fail or go off-line for maintenance. For example, when one object 

15 goes down because of aimlure of one computer, the objects that reference that failed object 
should not also fail. In addin&n, when the failed object eventually comes up, the objects that 
reference that failed object shoulasbe able to continue to access the object. This tracking of 
objects as they go down and comeSup can be very complex. For example, in a large 
distributed system, there may be no guafcartee that messages relating to when an object 

20 comes up or goes down are received in the ot4^t in which they are generated or event 
received at all. Thus, applications accessing the objBrts need to perform these complex 
processes to ensure that references are current. Current object models, however, provide 
very little support for tracking objects in such complex systems. 

Current object models, such as Microsoft's Component Object Model 
25 ("COM"), facilitate the implementing of complex systems that may use hundreds or 
thousands of objects. COM is more fully described in "Inside COM" by Dale Rogerson and 
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published by Microsoft Press in 1997. COM specifies that each object is to implement a 
certain interface referred to as the IUknown interface. An interface is a collection of 
functions that all are generally semantically related. The IUnknown interface provides a 
query interface function, an add reference function, and a release function. The query 
interface function is passed the identifier of an interface and returns a reference to that 
interface. The add reference and the release functions are used for reference counting the 
object. Each object that conforms to COM implements the IUknown interface. 

A client that requests to instantiate a COM object may receive a pointer to the 
IUknown interface in return. The client may then invoke the query interface function passing 
the identifier of another interface supported by that COM object. The query interface 
function returns a pointer to the requested interface. The client can then use the pointer to 
invoke one of the functions of the requested interface. Each interface of a COM object 
inherits the IUknown interface. Thus, each of these interfaces provide access to other 
interfaces and provides reference counting. Whenever a client duplicates a pointer to an 
interface of a COM object, the client is expected to invoke the add reference function, which 
increments the reference count to that COM object. Whenever the client no longer needs a 
pointer to an interface of a COM object, the client is expected to invoke the release function, 
which decrements the reference count to that COM object and destructs the COM object 
when the reference count goes to 0. 

SUMMARY 

A method and system for tracking the state of an entity (e.g., an object) on 
behalf of a client (e.g., an application program) is provided. The states of an entity include 
up and down. The tracking system of the present invention receives a request from a client 
to track the state of an entity. The tracking system then watches the state of the entity to 
detect when the entity enters the up state. When the entity enters the up state, the tracking 
system performs a behavior (e.g., notification) that is specified by the client to be performed 
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when the entity enters the up state. When the entity is in the up state, the tracking system 
monitors the state of the entity to detect when the entity enters the down state. When the 
entity enters the down state, the tracking system performs a behavior (e.g., notification) that 
is specified by the client to be performed when the entity enters the down state. When the 
tracking system receives a request from the client for a reference to the entity, the tracking 
system determines the current state of the entity and either provides a reference to the entity 
or indicates that a reference is not being provided. Such a reference allows a client to access 
the behavior of the entity. For example, the reference may be a pointer and the behavior is 
accessed by invoking a function of the entity using the pointer. 

In one embodiment, the tracking system receives notifications when the state of 
the entity has changed. When a notification is received, the tracking system retrieves a 
pointer to the entity. If the tracking system had previously retrieved a pointer to the entity, 
the tracking system determines whether the previously retrieved pointer and the newly 
retrieved pointer point to the same occurrence (e.g., instantiation) of the entity. If the 
references do not point to the same occurrence, then the tracking system notifies the client 
that the entity has gone down and then notifies the client that the entity has come up. In this 
way, the client is made aware that the previously retrieved pointer is out-of-date and that a 
newly retrieved pointer is available. In one embodiment, the tracking system determines 
whether the pointers point to the same occurrence based on the time at which the occurrences 
were created. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a state diagram that shows the state of the object tracking system 
while it tracks an object. 

Figure 2 is a block diagram illustrating the components of a system that uses 
the object tracking system. 
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Figure 2A is a block diagram illustrating the communications between a client 
and a resource manager. 

Figure 2B is a block diagram illustrating the watching of a resource. 

Figure 2C is a block diagram illustrating the monitoring of a resource. 

Figure 3 is a block diagram illustrating data structures of the resource tracking 

system. 

Figure 4 is a block diagram illustrating components of the resource manager. 
Figures 5-7 illustrate the data structures of the objects of the resource tracking 

system. 

Figure 8 is a flow diagram of an example implementation of the resource 
monitor component of the resource manager. 

Figure 9 is a flow diagram of an example implementation of the 
processResIsUp function of the resource monitor component. 

Figure 10 is a flow diagram of an example use of a resource pointer by a client. 

Figure 11 is a flow diagram of an example implementation of the 
RegisterResource function. 

Figure 12 is a flow diagram of example implementation of the getResourcePtr 

function. 
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Figure 13 is a flow diagram of an example implementation of a 
UnregisterResource function. 



Figure 14 is a flow diagram of an example implementation of the 
Directory: :addNewResClient function. 

Figure 15 is a flow diagram of the example implementation of the 
Directory: :resIsUp function. 

Figure 16 is a flow diagram of an example implementation of the 
Directory: :busIsUp function. 

Figure 17 is a flow diagram of an example implementation of the 
Directory: :findRefRes function. 

Figure 18 is a flow diagram of an example implementation of the 
Directory: :goingAway function. 

Figure 19 is a flow diagram of an example implementation of the watchRes 

function. 

Figure 20 is a flow diagram of an example implementation of the 
ResRef: :sendEventAndProcess function. 

Figure 21 is a flow diagram of an example implementation of the 
ResRef: :processEventsAndFreeLock function. 

Figure 22 is a flow diagram of an example implementation of the ResRef: :Init 

function. 
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Figure 23 is a flow diagram of an example implementation of the 
ResRef : :processRes!sUpMsg function. 



Figure 24 is a flow diagram of an example implementation of the 
ResRef: :processResIsDownMsg function. 

Figure 25 is a flow diagram of an example implementation of the 
ResRef: :processingClients function. 

Figure 26 is a flow diagram of an example implementation of the ResRef: :up 

function. 

Figure 27 is a flow diagram of an example implementation of the ResRef:: add 

function. 

Figure 28 is a flow diagram of an example implementation of the 
ResRef: :goingAway function. 

Figure 29 is a flow diagram of an example implementation of the 
ResRef: :getRefCountedPtr function. 

Figure 30 is a flow diagram of an example implementation of the 
ResRef: : delete Your self function. 

Figure 31 is a flow diagram of an example implementation of the 
Client: :resIsUp function. 

Figure 32 is a flow diagram of an example implementation of the 
Client: :res!sDown function. 
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Figure 33 is a flow diagram of an example implementation of the 
Client: : delete Yourself function. 



Figure 34 is a flow diagram of example implementation of the 
Client: :resourceIsUp function. 

Figure 35 is a flow diagram of an example implementation of the ResourceUp 
function of the resource manager. 

Figure 36 is a flow diagram of an example implementation of the 
ResourceDown function of the resource manager. 

Figure 37 is a flow diagram of an example implementation of the 
Directory: :watchRes function. 

Figure 38 is a flow diagram of an example implementation of the 
Directory:: stop WatchingRes function. 

Figure 38A is a flow diagram of an example implementation of a 
watchResIsUp function of the resource manager. 

Figure 39 is a flow diagram of an example implementation of the 
ClientProcessIsDown function of the resource manager. 

Figure 40 is a flow diagram of an example implementation of the attach 
function of the bus manager. 

Figure 41 is a flow diagram of an example implementation of the detach 
function of the bus manager. 
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Figure 42 is a flow diagram of an example implementation of the watchRes 
function of the bus manager. 



Figure 43 is a flow diagram of an example implementation of the 
stopWatchingRes function of the bus manager. 

Figure 44 is a flow diagram of example implementation of the nodelsDown 
function of the bus manager. 

Figure 45 is a flow diagram of an example implementation of the 
Directory: :monitorRes function. 

Figure 46 is a flow diagram of example implementation of the 
Directory: :stopMonitoringRes function. 

Figure 46A is a flow diagram of an example implementation of a 
processServerlsDown function. 

Figure 47 is a flow diagram of an example implementation of a resIsDown 
function of the resource manager. 

Figure 48 is a flow diagram of an example implementation of a connectClient 
function of a server node. 

Figure 48A is a flow diagram of an example implementation of the monitor 
resource function of the server node. 

Figure 48B is a flow diagram of an example implementation of the stop 
monitoring resource function of the server node. 
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Figure 49 is a flow diagram of example implementation of the clientlsAlive 
function of a server node. 

Figure 50 is a flow diagram of an example implementation of the resIsDown 
function of a server node. 

5 Figure 51 is a flow diagram of an example implementation of a 

noKeepAliveReceived function of the server node. 

Figure 52 is a flow diagram of an example implementation of the 

O 

i 3 processClientlsDown function of a server node. 

jLy 
i'U 

rll Figure 53 is a block diagram illustrating the communications between a server 

irl io resource and a client resource when watching a property. 

I; 3 Figure 54 is a block diagram of the components to support the watching of 

in 

I y properties by a client resource. 

■;: TP 

= 3 Figure 55 is a block diagram illustrating the components to support the 

watching of properties of a server resource. 

15 Figure 56 is a flow diagram of an example implementation of the watch 

property function of the server resource. 

Figure 57 is a flow diagram of an example implementation of the stop watching 
property function of the server resource. 

Figure 58 is a flow diagram of an example implementation of the monitor 
20 resource is down function of the server resource. 
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Figure 59 is a flow diagram of an example implementation of the set property 
function of the server resource. 

Figure 60 is a flow diagram of the process queue function. 

Figure 61 is a flow diagram of an example implementation of a register watch 
function of a client resource. 

Figure 62 is a flow diagram of an example implementation of the property set 
function of the client resource. 

Figure 63 is a block diagram illustrating components of the event system in one 

embodiment. 

DETAILED DESCRIPTION 

A method and system for tracking the state of objects and references to the 
objects is provided. The object tracking system in one embodiment provides an 
asynchronous notification mechanism for notifying a client, when an object that is referenced 
by the client changes state in a distributed object environment. An object can be either in an 
up state (e.g., instantiated) or a down state (e.g., destructed). The object tracking system also 
provides a mechanism through which a client can register its interest in accessing an object, 
can retrieve a pointer to the object when the object is in the up state, and can unregister its 
interest in accessing the object. The object tracking system interacts with an object manager 
that provides the facility to locate objects, to monitor the state of objects, and to retrieve 
pointers to the objects. The object manager notifies the object tracking system when objects 
change state. The object tracking system hides the complexities of tracking object state 
changes from the clients by working in conjunction with an installable object manager. In 
one embodiment, the object tracking system allows multiple clients to register their interests 
in the same object. A client as used in this specification refers to a process, a thread of 
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execution within a process, a routine, a module, a program, or some other programming 
entity that may need to track changes in state of an object. 

Figure 1 is a state diagram that shows the state of the object tracking system 
while it tracks an object. The four states are waiting for a client to register an interest in the 
5 object 101, initializing a reference to the object 102, watching for the object to enter the up 
state 103, and monitoring the object to enter the down state 104. When the object tracking 
system is in the waiting for a client state and it receives a register client request 105, it enters 
the initializing object reference state. During the initializing object reference state, the object 
p tracking system creates the data structures necessary to track the object for the client and 
j7i io determines the current state of the object. If the object is in the up state, then the object 
j * tracking system notifies the client that the object is up 107 and enters the monitoring object 
s! » state, else the object tracking system notifies the client that the object is down 106 and enters 

W- 5 

SJ the watching object state. In the watching object state, the object tracking system waits until 
o it receives notification from the object manager that the object has entered the up state 108 
v\ \ 15 and when notification is received, it notifies the clients and provides a pointer to the object 
^ and enters the monitoring object state. If the object tracking system receives a register client 
*-.3 request 109 while in the watching object state, it allocates the data structures for tracking the 
object for that client, notifies the client that the object is down, and stays in the watching 
object state. If the object tracking system receives a request to unregister a client 1 10-1 1 1, it 
20 deallocates the data structures for tracking that object for the client The object tracking 
system then enters the waiting for client state if no clients are left as registered. Otherwise, 
the object tracking system stays in the watching object state. In the monitoring object state, 
the object tracking system waits until it receives notification from the object manager that the 
object has entered the down state, and when so notified, it notifies the clients 112 and enters 
25 the watching object state. If the object tracking system receives a register client request 113 
while in the monitoring object state, it allocates the data structures for tracking the object for 
the client, notifies the client that the object is up, and stays in the monitoring object state. If 
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the object tracking system receives a request to unregister a client 1 14-1 15, it deallocates the 
data structures for tracking that object for the client. The object tracking system then enters 
the waiting for client state if no clients are left as registered. Otherwise, the object tracking 
system stays in the monitoring object state. The term "component" refers to any hardware or 
5 software entity that can be tracked. A hardware component may be a device such as a CD 
player, and a software component may be a computer routine, object, thread, process, and so 
on. A software component may serve to control a hardware component. For example, a 
software component may serve as a programmatic interface to a CD player. The objects and 
resources are types of software components; and the object tracking system can be used to 

0 10 track any software component. A "tracking reference" is a reference that identifies a 

1 y software component and can be used to request that the availability of a software component 
j y be tracked. A software component that requests that another software component be tracked 
:!! may be notified when the tracked software component becomes available (up) and 

^ unavailable (down). When a software component becomes available a "behavioral 
i;3 15 reference" can be retrieved and used to access the behavior of the software component so 
ry long as the software component stays available. For example, a tracking reference may be 
^ the name of a software component, and a behavioral reference may be a pointer to a software 
'3 component. 



20 where the objects are long-lived and where there is no guarantee that notification of changes 
in the state of objects will be received in the same order as they are generated. For example, 
an object may correspond to and monitor a real-world component (e.g., a light). Since the 
real-world component is always in an up state in the sense that it can always be utilized, the 
corresponding object should always be in the up state. A client that also corresponds to a 

25 real-world component (e.g., a light switch) that wants to control the physical state of another 
real- world component (e.g., the light) may register an interest in the object that controls the 
other real-world component. While the client is executing/ it may not need to actually access 

[30581-8002/Application.doc] 



The object tracking system correctly tracks the state of objects in environments 




14 

the object for long periods of time. During that time period, the object may occasionally 
enter the down state because, for example, the computer on which the object resides has a 
failure or a new version of code for the object is provided. The object tracking system tracks 
these changes of states and notifies the client. When the client eventually decides to access 
the object, it requests the object tracking system to provide a pointer to the object. 

The object tracking system also tracks each new instantiation of an object to 
help ensure that current behavioral reference (e.g., pointer) held by the object tracking 
system points to the currently instantiated object. In one embodiment, the object tracking 
system uses the creation time of different instantiations of the same object to ensure the 
validity of a pointer. A problem may arise if the object tracking system receives notifications 
from the object manager that are out of order. For example, the object tracking system may 
receive two notifications that an object is up without receiving an intervening notification 
that the object is down. The two notifications that the object is up may correspond to either 
redundant notifications (e.g., because of retransmission) or notifications of two different 
instantiations of the object. Since the object tracking system may have a pointer to the 
object, it needs to ensure that the pointer is correct. In certain situations there is no guarantee 
that two pointers to the same instantiation of an object will be the same. In particular, the 
object may want to track the particular client to which a pointer is provided and may provide 
different valued pointers to track which client is accessing the object. For example, the 
object may want to track the clients to enforce different access rights for different clients. To 
ensure the pointer is current, the object tracking system compares the creation time of the 
current object with the creation time of the object whose pointer it has. If the times are 
equal, then the object tracking system does not need to notify the clients that the object has 
changed state. If, however, the creation times are different, then the object tracking system 
can notify the clients and the clients can request new pointers as appropriate. 

Figure 2 is a block diagram illustrating the components of a system that uses 
the object tracking system. In the fallowing, the terms "object" and "resource" are used 
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interchangeably. \These terms refer to any software entity that can be tracked and that may 
correspond to a realWorld component. The system includes nodes 201 and a bus manager 
202 that are interconnected through a communications link or bus 204. The communications 
link can be any physicaPor logical means for communicating between entities. Each node 
may contain resources that reauest access to other resources. A resource that requests access 
to another resource is referred to as a client resource or client, and a resource that is accessed 
by another resource is referred tovas a server resource or server. The bus manager tracks all 
the resources as they come up and\go down. The bus manager receives notifications when 
each resource comes up and goes down. Each node on which a resource is located, referred 
to as a server node, notifies the bus manager when a resource comes up in that mode referred 
to as "attaching" and notifies the bus manager when a resource goes down in a process 
referred to as "detaching." 

X 

ie watching of a resource is coordinated by the bus manager, but the 
monitoring of a resource is performed on a client-to-server node basis without interaction 
from the bus managhr. When a client wants to watch a resource so that it knows when the 
resource is in the up\tate, the client node notifies the bus manager. The resource is 
identified using a tracking rrference. If the resource is already up, then the bus manager then 
notifies the client node that the^esource is up. Otherwise, the bus manager notifies the client 
node when the resource comes up^/hen the client node is notified that the resource is up, it 
may notify the bus manager to stop watching for the resource. The monitoring of a resource 
is performed on a peer-to-peer basis. ThaKis, once a client node is informed that an resource 
has entered the up state, it establishes a conn^tion directly with the server node that contains 
the resource. Once the connection is established, the client node notifies the server node 
periodically that it is still up and running. If the server node does not receive this 
notification, it assumes that the client node is no longer^ap and running and resets its internal 
state accordingly. Similarly, if the client node receives ark error when sending its periodic 
notification to the server node, it assumes the server node is d\wn and resets its internal state 
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accordingly. When the resource goes down, the server node notifies the client node that the 
resource is hctw down. Each node includes clients 205, a resource tracking system 206, and 
£V a resource manag&s£07. A client requests the resource tracking system to provide pointers 
to resources and to notn^sthe client when resources come up or go down. The resource 
5 tracking system interacts with th£^source manager to watch, monitor, and retrieve pointers 
to the resource. The resource manager ats(^ detects when resources on its node come up and 
go down and notify the bus manager or otherwheres as appropriate. The nodes may all be 
computer systems with a central processing unit, m&H^ry, and input/output devices. The 

software components and data structures of these nodes may^tie stored on computer-readable 

X 

i;3 10 medium such as memory, CD-ROM, flexible disk, hard disk;\and so on and may be 

Q 

i ;i transmitted via a data transmission medium. 



Figure 2 A is a block diagram illustrating the communications between a client 

in 

SJ and a resource manager. Client 2A01 sends various messages to the resource manager 2A02 
n to request the watching and the monitoring of resources. The resource manager notifies the 
'];:; 15 client by sending messages to the client that the resource has come up or gone down. In one 
'-jf embodiment, the message passing is generally performed by invoking functions of various 
= 3 objects that have the same name as the message. The client sends a watch resource message 
to request the resource manager to start watching for a resource to come up. The client sends 
a stop watching resource message to the resource manager to indicate that the client no 
20 longer wants or needs the resource manager to watch for a certain resource. The client sends 
a monitor resource message to request the resource manager to start monitoring for a 
resource that is up to go down. The resource manager detects (e.g., by receiving messages 
from the bus manager) when a resource that is being watched goes up and detects (e.g., by 
receiving an attach or detach message from the node on which the resource is located) when 
25 a resource that is being monitored goes down and sends a resource is up or a resource is 
down message to the client. The resource tracking system serves as an interface of the client 
to the resource manager. 
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igure 2B is a block diagram illustrating the watching of a resource. The client 
node 2B10 is a Vode on which a client 2B1 1 has requested to watch for a certain resource to 
come up. The Mient node tracks the resource with components 2B12 of the resource 
manager. The resource manager includes a watched resource table 2B13, a process/resource 
5 list 2B14, and resource directory 2B15. The client and the resource manager interact as 
described in Figure 2A. Yrhe resource manager interacts with a bus manager 2B20 to notify 
the bus manager when resources of that node go up and come down and to request that the 
bus manager watch for a resource on the client node's behalf. The bus manager includes a 
bus manager component 2B21\that has a watched resource table 2B22 and a resource 

3 10 directory 2B23. The watched resource table at the client node contains an indication of each 

^ \ 

d resource that a client located at that ntode has requested to watch along with an indication of 
5 the requesting client. The resource directory at the client node contains the identification of 
3- each resource that is currently up at the client node. The resource manager uses the resource 
J directory to re-notify the bus manager of thesresources that are up in the event that the bus 
3 15 manager goes down and then comes back up ok when another bus manager takes control of 
y the bus. The resource manager similarly uses theVatched resource table to re-notify the bus 
5 manager of the resources that its clients are watchdog. The process/resource list identifies 
~ each resource by the process in which it is executing. When a process goes down, the 
resource manager can use the process/resource list to Vrtify the bus manager that those 
20 resources are now down. The client node sends to theYus manager an attach resource 
message whenever a resource comes up and a detach resource* message whenever a resource 
goes down. The client node sends a watch resource message to\he bus manager to notify the 
bus manager to start watching for a particular resource to come up. The client node keeps 
track of the resources that its watching in the watched resource table. If a client requests to 
25 watch a resource that another client on the same node is already watching, then the client 
node does not need to send another watch resource message to the bu\ manager. The client 
node sends a stop watching resource message to the bus manager whenever it wants to stop 
watching for a resource to come up. The client node may want to stbp watching for a 
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resours^ whenever all of its clients who were watching the resource request to stop watching 
the resource^or whenever the resource conies up. The client node sends a find resource 



message to the ous manager when it wants to retrieve a pointer to a resource. When a client 
comes up, the bus mkmger sends a watched resource is up message to each client node that 
is watching that resourc^v The watched resource table of the bus manager contains an 
identifier of each resource thaiKbeing watched and the client node that requested a watch of 
that resource. The resource direob^y of the bus manager contains an identifier of and a 
pointer to each resource that is curreimyup. When the bus manager receives an attach 
resource message, it updates the resource direbtmy to indicate that the resource is up. It then 
P 10 checks the watched resource table to determine wh^tfier any client nodes are watching that 
resource. If so, the bus manager sends a watched resolute is up message to each such client 
node. When the bus manager receives a detach resource message, it updates its resource 
directory to indicate that the resource is now down. When the Ih^s manager receives a node 
1 is down message, it effectively detaches all resources that were attab^ed at the node that is 
1 15 now down and effectively stops all the watches from that node. 

Figure 2C is a block diagram illustrating the monitoring of a resource. The 
client node 2C10 includes a client resource 2C11 and a client-side monitor resource 
component 2C12, which is part of the resource manager. The server node 2C20 includes a 
server resource 2C2 1 and a server-side monitor resource component 2C22, which is part of 
20 the resource manager. The server-side monitor resource component and the client-side 
monitor resource component interact to effect the monitoring of resources on a peer-to-peer 
basis. Each node may be both a server node and a client node and thus may have both 
server-side and client-side monitor resource components. When a client wants to start 
monitoring a resource or to stop monitoring a resource, it sends a monitor resource or a stop 
25 monitoring resource message to the resource manager as described in Figure 2A. When the 
client node receives a request to monitor a resource from a client on that node, it uses the 
reference to the resource passed by the client to identify the server node at which the 
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resource is located. The client node then sends a connect client message to the server node if 
a connection is not already established. The connect client message includes a pointer to an 
interface of the client node along with a client context for the client node. When the server 
node receives the connect client request, it determines whether a connection has already been 
5 established with that client node. If a connection has already been established, then the 
server node assumes that the client node has gone down since the connection was last 
established and adjusts its state accordingly and returns an error to the client node. 
Otherwise, the server node returns a server context. If the client receives an error in return, it 
can again attempt to establish a connection with the server node. The combination of client 
!3 10 context and server context uniquely identifies the connection. The client node periodically 
jj notifies the server node that the client node is still alive by sending a client is alive message, 
ft If the server node detects that a client is alive message has not been received from the client 
~ node during that period, then the server node assumes that the client node is down and 
" J cancels the connection with the client node. After a connection is established, the client 
3 15 node requests to monitor resources on a per resource basis. The client node sends a monitor 
y resource message or a stop monitoring resource message to the server node identifying the 
3 resource. The server node records a mapping between the resource and the client node and 
" notifies the client node when that resource goes down. If the resource is down when the 
monitor resource message is received, then the server node notifies the client node that the 
20 resource is down. The client node maintains a monitor resource table 2C13 and a client 
connection table 2C14. The monitor resource table contains a mapping of resources being 
monitored to the clients that requested to monitor the resources. The client connection table 
contains the identification of the server node to which the client nodes is connected along 
with the client context and the server context for the current connection. The server 
25 connection table 2C23 contains references to the client nodes to which the server node is 
connected along with the client context and the server context for the current connection. 
The monitoring node table 2C24 contains a mapping from each resource that is being 
monitored to the monitoring client nodes. 
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Resource Tracking System/Resource Manager Interface 

Figure 3 is a block diagram illustrating data structures of the resource tracking 
system. The resource tracking system provides a directory object 301, a list of resource 
reference objects 302\and, for each resource reference object, a list of client objects 303. 
5 The directory object provides functions for controlling the access to resources by interacting 
with an installable resource ^manager. The directory object maintains a resource reference 
object for each resource that a c^ent has registered to track. Each resource reference object 
contains the name of the resource atui, if the resource is up, a unique instance identifier of 
the resource (e.g., a pointer to the resource and the time at which the resource was created). 
i io Each resource reference object also contains a pointer to a client list of client objects that 
H each represent a client that has registered to\ack the corresponding resource. Whenever a 
y client wants to reference to a resource, it supplies a client object to the resource tracking 
il system. This client object includes functions that tfte resource tracking system uses to notify 
the client when the resource changes its state (e.g., a\call-back routine). Since these data 
J5 15 structures may be accessed concurrently by multiple threads of execution, a concurrency 
% management technique is used when accessing these data structures. For example, before 
3 accessing a data structures, a thread may lock the data stracUirfe and then unlock it after the 
access is complete. In the following, the description of the functions that access these data 
structures omit these well-known concurrency management techniques 

20 Figure 4 is a block diagram illustrating components of the resource manager. 

The resource manager 400 includes a watch resource component 401a and monitor resource 
component 401b, an implementation of resource tracking functions of the directory object 
402-406, and a reference 407 to the directory object. The resource manager provides the 
implementation of the resource tracking functions so that the resource tracking system can be 

25 independent of the particular resource manager. For example, the resource manager may 
manage resources in the same computer in which the clients execute or on different 
computers that are connected via a local area network or connected via the Internet. Thus, 
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the resource manager is installable in the sense that the resource tracking system can interact 
with any resource manager that provides these functions and notifies the resource tracking 
system by invoking certain functions as specified below. The watch resource component and 
the monitor resource component each provide sub-components to support watching and 
monitoring of resources. 

Figures 5-7 illustrate the data structures of the objects of the resource tracking 
system. The tables on the left 501, 601, 701 contain the data of the objects and the tables on 
the right to 502, 602, 702 contain the names of the functions of the objects. Table 1 contains 
a de scription of the data and functions of each of these objects. 

X Table 1 



Directory Object 



Name X 


Description 


myResRefList X X S 


A pointer to the resource reference list for this directory object. 


addNewResClient 


"Xjunction that is invoked by a client to register that it wants to track a resource. 


resIsUp 


A fuhrtion that is invoked by the resource manager to notify the resource tracking 
system th^t a resource is up. 


resIsDown 


A function Ihqt is invoked by the resource manager to notify the resource tracking 
system that a resource is down. 


busStateChanged 


A function that is Ih^oked by the resource manager to notify the resource tracking 
system that the bus hafcychanged state (i.e., came up or gone down). 


reevaluateRefs 


A function that is invokebsby the resource manager to notify the resource tracking 
system to reset all its referenbeto the down state. 


clearlnitialBlock 


A function that is invoked by tnb>resource manager to notify the resource tracking 
system to start processing notificatibqs. 


goingAway 


A function that is invoked by a resourc&Nreference object to notify the directory 
object that a resource reference object is goh^g away. 


monitorRes 


A function that is implemented by the resourc^Stnanager and invoked by the 
resource tracking system to notify the resource mah^ger to start monitoring a 
resource to go down. This function may be provideci^a derivation of the directory 
object. 


stopMonitoringRes 


A function that is implemented by the resource manager ancNnvoked by the 
resource tracking system to notify the resource manager to storvfcKmitoring a 
resource to go down. This function may be provided as a derivation^ the directory 
object. X 


watchRes 


A function that is implemented by the resource manager and invoked by^e 
resource tracking system to notify the resource manager to start watching fofc^a 
resource to come up. This function may be provided as a derivation of the directory 
object. \ 


stopWatchingRes 


A function that is implemented by the resource manager and invoked by the \ 
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Name 


Description 




resource tracking system to notify the resource manager to stop watching for a 
resource to come up. This function may be provided as a derivation of the 
directory object. 


findRes 


A function that is implemented by the resource manager and invoked by the 
resource tracking system to retrieve a pointer to a resource. This function may be 
provided as a derivation of the directory object. 



Resource Reference Object 


Name 


Description 


myClientList 


A pointer to the client list for this resource reference object. 


myResName 


The name of the resource. 


myResPtr 


A pointer to the resource. 


myResCreatedTime 


The time when the resource was created. 


myQueue 


A queue for notifications relating to this resource. 


mylsProcessing 


A flag indicating that a thread is processing the notifications that are on the 
queue. 


myDirPtr 


A pointer to the directory object. 


myResrdnstld 


A synonym for the name of the resource. 


getRefCountedPtr 


A function that returns a reference counted pointer to the resource. 


down 


A function that is invoked by the directory object to indicate that the 
resource has gone down. 


up 


A function that is invoked by the directory object to indicate that the 
resource has come up. 


aaa 


A function that adds a client object to the client list for this resource 
reference object. 


init 


A function invoked by the directory object to initialize the resource 
reference object. 


deleteYourself 


A function that is invoked by the directory object when it is destructed. 


goingAway 


A function that is called by a client object to notify the resource reference 
object that the client object is being deleted. 


clearClients 


A function that is invoked to remove the client objects from the client list. 


processEventsandFreeLock 


A function that processes the notifications that are on the queue. 


sendEventandProcess 


A function that adds notifications onto the queue. 


processResIsUpMsg 


A function that processes a notification that a resource is up. 


processResIsDownMsg 


A function that processes a notification that a resource is down. 


processResInitMsg 


A function that processes a notification to initialize this resource reference 
object. 


tellClientsResIsUp 


A function that is invoked to notify clients that a resource is up. 


tellClientsResIsDown 


A function that is invoked to notify clients that a resource is down. 


processClients 


A function that is invoked to invoke a passed function for each client object 
in the client list for this resource reference object. 


Client Object 



Name 


Description 


myRefResPtr 


A pointer to the resource reference object for this client object. 


mylID 


The interface identifier of the interface of the resource that the client wants 
returned. 


mylnterfacelsSet 


A flag that indicates whether the client wants a pointer maintained to a specific 
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Name 


Description 




interface of the resource. 


mylnterfacePtr 


The pointer to the interface. 


getRefCountedPtr 


A function that returns a reference counted pointer to the resource. 


getlnterfacePtr 


A function that returns a pointer to the interface. 


deleteYourself 


A function that is invoked by the resource reference object when it is deleting 
itself. 


resIsUp 


A function that is invoked by the resource reference object to notify this client 
object that the resource is up. 


init 


A function that initializes the client object. 


resIsDown 


A function that is invoked by the resource reference object to notify this client 
object that the resource is down. 


resourcelsUp 


A function provided by the client that is invoked by this client object to notify the 
client that the resource is up. This function may be provided as a derivation of the 
client object. 


resourcelsDown 


A function provided by the client that is invoked by this client object to notify the 
client that the resource is down. This function may be provided as a derivation of 
the client object. 



Lter used may be "smart pointer" such that when a pointer is copied it is 
automatically reference comited^^ien the pointer is reset to a new it is automatically 
released. When a smart pointer goes out oT^Cope^itsdestructor releases it. The myResPtr 
of the resource reference object and myRefResPtr of the cliento^Bct-ai^smart pointers. 

Figure 8 is a flow diagram of an example implementation of the resource 
manager when it detects a change in state of a resource that is being watched or monitored by 
a client on this node. In step 801, if the resource manager detects that a resource has come 
up, then, in step 802, the resource manager invokes its processResIsUp function passing an 
identifier of the resource. In step 803, if the resource manager detects that the resource has 
gone down as indicated by the server node, then, in step 804, the resource manager invokes 
its processResIsDown function passing an identifier of the resource. In step 805, if the 
resource manager detects a change in the state of the bus, then, in step 806, the resource 
manager invokes its busStateChange function. 

Figure 9 is a flow diagram of an example implementation of the 
processResIsUp function of the resource manager. This function is passed an indication of 
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the resource and, if the resource is being tracked (i.e., watched or monitored), the function 
notifies the resource tracking system by invoking a function of the directory object. In steps 
901-903, the function loops selecting each resource that is being tracked to determine 
whether the notification is for that resource. In the step 901, the function selects the next 
5 tracked resource from a tracked list (e.g., the watched resource table), which contains the 
identification of the resources that are being tracked. In the step 902, if all the resources 
have already been selected, then the resource is not being tracked and the function returns, 
else the function continues at step 903. In step 903, if the selected resource matches the 
passed resource for which the notification was received, then the function continues at 

3 10 step 904, else the function loops to step 901 to select the next resource. In step 904, the 

-3 

J function invokes the resIsUp function of the directory object passing the context of (e.g., 

: U 

Q pointer to the resource reference object for the resource) the resource, which was passed to 

=a 

~ the resource monitor as part of the registration process. The function then returns. The 

^ resource manager implements an analogous function for processing resource down 

3 15 notifications. The busStateChanged function causes each client to reset by invoking the 

LJ busStateChanged function of the directory object and resets it internal state. 

: ^ ' i 

3 Figure 10 is a flow diagram of an example use of a resource pointer by a client. 

In step 1001, the client invokes to the RegisterResource function passing the name of the 
resource and receiving a handle to the resource in return. In step 1002, the function invokes 
20 the getResourcePtr function passing the handle to the resource and receiving a pointer to the 
resource in return. The client may periodically check whether it has been notified of a 
change in state in the resource. If so, the client can use the handle to retrieve a reference 
counted pointer to a current instantiation of the resource. When the client no longer needs 
the pointer, it releases the pointer. The client may also receive asynchronous notifications 
25 from the resource tracking system via the resourcelsUp and resourcelsDown functions that it 
implements and provides to the resource tracking system. 
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Figure 11 is a flow diagram of an example implementation of the 
RegisterResource function. This function is invoked by a client to register an interest in a 
resource. The client identifies the resource by providing the name of the resource. The 
function returns a handle that identifies the resource. The function has two parameters: the 
name of the resource instance (resInstName) and resource handle (resHandlePtr). In 
step 1101, the function creates a new element object, which is derived from a client object. 
The element object adds handle management to a client object. In the step 1 102, the function 
retrieves a handle for the new element object and sets the resource handle to be returned to 
the client to the retrieved value. In step 1103, the function adds the client object to the 
resource tracking system data structures by invoking the Directory: :addNewResClient 
function passing the resource name and the element object. The function returns after the 
client object has been added. The element object may maintain a mapping from the handles 
to the client objects in a handle resource table. Alternatively, the handle may be a pointer to 
the client object. 

Figure 12 is a flow diagram of example implementation of the getResourcePtr 
function. This function is passed the handle of a resource and returns a pointer to the 
resource. In step 1201, the function selects the next entry in the handle/resource table. In 
step 1202, if all the entries have already been selected, then the function returns an error, else 
the function continues at step 1203. In step 1203, if the passed handle matches the handle in 
the selected entry, then the function continues at step 1204, else the function loops to 
step 1201 to select the next entry. In step 1204, the function retrieves a reference counted 
pointer to the resource by invoking the getRefCountedPtr function of the client object that is 
indicated in the selected entry. The function then returns. 

Figure 13 is a flow diagram of an example implementation of a 
UnregisterResource function. This function undoes the processing of the RegisterResource 
function. This function is passed the handle for the resource. In step 1301, the function 
retrieves the client object by invoking the getClient function passing the handle. In 
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step 1302, the function directs the client object to delete itself by invoking the delete Yourself 
function of the client object. In step 1303, the function removes the handle from the 
handle/resource table and returns. 

Directory Object 

igures 14-19 are flow diagrams illustrating the functions of the directory 
objects. Figute 14 is a flow diagram of an example implementation of the 
Directory: :addNewStesClient function. This function adds a new client object for a resource 
to the directory. ThiMunction is passed the name of the resource (resName) and the client 
object. In step 1401, thkfunction finds the resource reference object associated with the 

5,3 io passed resource name by invoking the findRefRes function of the directory object. That 

I. y \ 

ry function searches the resource inference list and returns a reference to a resource reference 

fit 

object with that name. In step 1^02, if resource reference object with that name is found, 
then the function continues that step\407, else the function continues at step 1403. In steps 
1403-1406, the function adds a resource reference object for the named resource to the 
ri 15 resource reference list. In step 1403, thesfunction creates a resource reference object. In 
iq step 1404, the function adds the resource reference object to the resource reference list of 
this directory object. In step 1405, the fimctionWds the client object to the client list of the 
resource reference object by invoking the add function of the resource reference object 
passing the client object. In step 1406, the function signals the clients that the resource is up 
20 by invoking the up function of the resource reference object. If the resource is not actually 
up, the resource tracking system will enter the watch for resfcuirce state for this resource and 
notify clients that the resource is down. In step 1407, the function adds the client object to 
the client list of the resource reference object by invoking the adcr&nction of the resource 
reference object. In step 1408, the function initializes the client objecfcyby invoking the init 
25 function of the resource reference object passing the client object and then returns. 

Figure 15 is a flow diagram of the example implementation of the 
Directory: :resIsUp function. This function is passed the context of a resource (e .g., a pointer 
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to a resource reference object for the resource) and sets the corresponding resource reference 
object to indicate that the resource is up. This function is invoked by the resource manager 
to notify the resource tracking system that the resource is up. In step 1501, the function 
retrieves a pointer to the resource by invoking the findRefRes function of this directory 
5 object passing the context. In step 1502, if a resource reference object was found, then the 
function continues at step 1503, else the function returns an error indication. In step 1503, 
the function invokes the up function of the resource reference object to notify the clients that 
the resource is up. The function then returns. The Directory: :resIsDown function operates 
in an analogous manner except that the down function of the resource reference object is 
!!3 io invoked in step 1503. 

S : 1 

?y Figure 16 is a flow diagram of an example implementation of the 

f y- 

; J Directory: :busStateChanged function. This function is invoked by the resource manager to 

i.i i 

S] indicate that the state of the bus has changed. In step 1601, the function selects the next 

i 3 resource reference object in the resource reference list. In step 1602, if all the resource 

in 

S;jji5 reference objects have already been selected, then the function returns, else the function 
continues at step 1603. In step 1603, if there is a client object in the client list of the selected 

O resource reference object, then the function continues step 1604, else the function loops to 
step 1601 to select the next resource reference object. In step 1604, the function reference 
counts the resource reference object by invoking the AddRef function. In step 1605, the 
20 function invokes the up function of the selected resource reference object to notify the client 
objects that the resource is up. If the bus is down, the up function will be unable to locate 
the resource and cause the resource tracking system to enter the watching for resource state. 
In step 1606, the function invokes the release function of the resource reference object to 
decrement the reference count and loops to step 1601 to select the next resource reference 
25 object. Two other functions of the directory object operate in an analogous manner. The 
resetRef function performs the same processing except that in the step 1605 the function 
invokes the down function of the resource reference object after the up function is invoked. 
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This resets all the references to the resources to the down state. The clearlnitialBlock 
function also performs the same processing except that in step 1605 the function invokes the 
clearlnitialBlock function, rather than the up function, which processes the events in the 
message queue (described below) of the resource reference objects. The resource manager 
invokes this function after a client resource is activated so that the client resource can start 
processing events. 

Figure 17 is a flow diagram of an example implementation of the 
Directory: :findRefRes function. This function is invoked passing the name of a resource. 
The function returns the resource reference object corresponding to that name. In step 1701, 
the function selects the next resource reference object in the resource reference list. In 
step 1702 if all the resource reference objects have already been selected, then the function 
returns an error indication, else the function continues at step 1703. In step 1703, if the 
passed name matches the name of the selected resource reference object, then the function 
reference counts the resource reference object and returns a pointer to that resource reference 
object, else the function loops to step 1701 to select the next resource reference object. The 
directory object has another function with the same name that operators in an analogous 
manner except that it is passed a context of (e.g., pointer to) the resource reference object 
rather than the name. 

Figure 18 is a flow diagram of an example implementation of the 
Directory: :goingAway function. This function is passed a resource reference object and 
performs the processing to indicate that the resource reference object is going away, that is, 
the last client is unregistering its interest in the resource. In step 1801, if there are client 
objects on the client list of the passed resource reference object, then some client objects are 
waiting to be deleted and the resource cannot go away and the function returns, else the 
function continues at step 1802. In step 1802, the function removes the resource reference 
object from the resource reference list. In step 1803, the function retrieves a reference 
counted pointer to the resource by invoking the getRefCountedPtr function of the resource 
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reference object. In step 1804, if a reference counted pointer was retrieved, then the resource 
is up and the function continues at step 1805, else the function continues at step 1807. In 
step 1805, the function releases the resource by invoking its Release function. In step 1806, 
the function invokes the stopMonitoringRes function passing the resource reference object to 
notify the resource manager to stop monitoring for the resource to go down. In step 1807, 
the function invokes the stopWatchingRes function passing the resource reference object to 
notify the resource manager to stop watching for the resource to come up. In step 1808, the 
function releases the resource reference object by invoking the Release function of the 
resource reference object and then returns. 

Figure 19 is a flow diagram of an example implementation of the watchRes function. 
The function is passed a reference object and places a watch on the resource. In steps 1901- 
1903, the function loops determining whether that resource is already in the tracked resource 
list (e.g., watched resource table). In step 1901, the function selects the next resource in the 
tracked resource list. In step 1902, if all the resources have already been selected, then the 
function continues at step 1905, else the function continues at step 1903. In step 1903, if the 
selected resource matches the passed resource, then the function continues in step 1904, else 
the function loops to step 1901 to select the next resource. In step 1904, the function sets the 
entry for that resource to being watched and returns an indication of a duplicate watch. In 
step 1905, the function adds an entry to the tracked resource list that points to the passed 
resource reference object. In step 1906, the function sets the entry for that resource to being 
watched and returns. The stopWatchingRes, monitorRes, and stopMonitoringRes functions 
operate in an analogous manner. Further implementations of these functions are described 
below. 

B. Resource Reference Object 

Figures 20-30 are flow diagrams illustrating the processing of the functions of 
the resource reference objects. Figure 20 is a flow diagram of an example implementation of 
the ResRef::sendEventAndProcess function. This function is passed an event and a 

[30581-8002/Application.doc] 

3o 




30 



parameter and places the event and parameter on the message queue for the resource 
reference object and then processes the event and parameters that are on the queue. The 
event can be an indication that the resource is up or down or is being initialized. In 
step 2001, the function puts the event and the parameter on the message queue for the 
5 resource reference object. In step 2002, if another thread is processing messages for this 
resource reference object, then the function returns, else the function continues at step 2003. 
In step 2003, the function sets a processing flag to true. In step 2004, the function invokes 
the processEventsAndFreeLock function of this resource reference object to process the 
messages in the message queue. 

hi 

I j io Figure 21 is a flow diagram of an example implementation of the 

I ,rj ResRef::processEventsAndFreeLock function. This function loops retrieving messages from 

! ™ the message queue for this resource reference object. The function determines the type of 

v\ 

% ! the message and performs the necessary processing. In step 2101, if this resource reference 
O object is already processing a message (e.g., invoked by another thread), then the function 
j jjis returns, else the function continues at step 2102. In step 2102, the function retrieves a 
*t message from the message queue. In step 2103, if all the messages have already been 
u retrieved, then the function continues at step 2109, else the function continues at step 2104. 
In steps 2104-2105, the function determines whether the retrieved message indicates that the 
resource is up or down, or is being initialized. In steps 2106-2108, the function invokes the 
20 appropriate function (i.e. 9 processResIsUpMsg, processResIsDownMsg and 
processResInitMsg) of this resource reference object to process the retrieved message. The 
function then loops to step 2102 to retrieve the next message from the message queue. In 
step 2109, the function sets the processing flag to false. In step 2110, the function invokes 
the clearClients function of this resource reference object and returns. The clear clients 
25 function deletes any client objects whose delete flag is set. 

Figure 22 is a flow diagram of an example implementation of the ResRef::Init 
function. This function is passed a client object, and in step 2201, the function places a 
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message on the message queue of this resource reference object to initialize that client. The 
function then returns. 



ResRef::processResIsUpMsg function. This function is invoked when a message indicating 
5 that the resource is up is retrieved from the message queue. In step 2301, the function 
invokes the findRes function of the directory object to retrieve a pointer to the resource. The 
findRes function is supplied by the resource manager. In step 2301, if a pointer to the 
resource is returned, then the resource is up and the function continues at step 2304, else the 
resource went down since the up message was generated and the function continues at 

10 step 2303. In step 2303, the function notifies the resource manager to start watching the 
resource to come up by invoking the watchRes function of the directory object passing this 
resource reference object and then returns. In step 2304, the function retrieves the created 
time of the resource. In step 2305, if the pointer to the reference in the reference resource 
object is null (which may mean that this resource reference object recognized that the 

15 resource was down) or the created time of the resource is not equal to the created time 
indicated in this resource reference object (which may mean that a new occurrence of the 
resource has been instantiated), then the function continues at step 2306, else this reference 
resource object already has the correct pointer to the resource and the resource is already 
being monitored so the function returns. In step 2306, if this resource reference object has a 

20 pointer to the resource, then the pointer is out-of-date and the function continues at 
step 2307, else the function continues at step 2308. In step 2307, the function sets the 
resource pointer in this resource reference object to null, notifies the client objects that the 
resource is down by invoking the tellClientsResIsDown function, directs the resource 
manager to stop monitoring the resource, and sets the created time for the resource to zero. 

25 In step 2308, the function directs the resource manager to stop watching the resource by 
invoking the stopWatchingRes function of the directory object. In step 2309, if the 
stopWatchingRes invocation was successful, then the resource is up and the function 
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continues at step 2311, else the function continues at step 2310. In step 2310, the function 
directs the resource manager to start watching the resource by invoking the watchRes 
function of the directory object and then returns. In step 23 1 1, the function sets the resource 
pointer to point to the resource provided in step 2301, sets the created time of this resource 
5 reference object to the new created time, and directs the resource manager to start monitoring 
the resource by invoking the monitorRes function of the directory object. In step 23 12, if the 
start of monitoring is successful, then the function continues at step 2313, else the function 
continues at step 23 14. In step 23 13, the function notifies the client objects that the resource 
is up by invoking the tellClientsResIsUp function and returns. In step 2314, the function 

Q 10 records that the resource is down by setting the resource pointer to null and setting the 

ly created time to zero for this reference resource object and returns. 

nn 

fy 

; : = Figure 24 is a flow diagram of an example implementation of the 

3. : 5 

H ResRef::processResIsDownMsg function. This function is invoked to process the resource 

t: 

□ down message that is retrieved from the message queue. In step 2401, if this resource 
fjj 15 reference object points to a resource, the function continues at step 2402, else the resource 
4; reference object already indicates that the resource is down and the function continues at 
^ 3 step 2409. In step 2402, the function requests the resource manager to supply a resource 
pointer by invoking the findRes function of the directory object. In step 2403, if the pointer 
to the resource is supplied, then the resource is now up and the function continues at 
20 step 2404, else the function continues at step 2408 to indicate that the resource is really 
down. In step 2404, the function retrieves the created time of the resource. In step 2405, if 
the created time of the resource is equal to the created time stored in the resource reference 
object, then the function continues at step 2406, else the reference to the resource is out-of- 
date because the resource went down and has already come back up and the function 
25 continues at step 2408 to indicate that the resource went down. In step 2406, the function 
sets the resource reference object to point to the resource and directs the resource manager to 
start monitoring the resource by invoking the monitorRes function of the directory object. In 
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step 2407, if the start of monitoring was successful, then the function returns, else the 
function continues at step 2408. In step 2408, the function sets the resource pointer of this 
resource reference object to null, notifies the client objects that the resource is down by 
invoking the tellClientsResIsDown function, directs the resource manager to stop monitoring 
the resource by invoking the stopMonitoringRes function of the directory object, and sets the 
created time of the resource to zero. In step 2409, the function simulates the receiving of a 
resource up message from the application by invoking the processResIsUpMsg function. 
That invocation will start watching the resource if it is not up and start monitoring the 
resource if it is up. 

Figure 25 is a flow diagram of an example implementation of the 
ResRef::processingClients function. This helper function is passed an indication of which 
function of the client objects to invoke. The function loops selecting each client object and 
invoking that function. In step 2501, the function loops selecting each client object in the 
client list. In step 2502, if all the client objects in the client list have already been selected, 
then the function returns, else the function continues at step 2503. In step 2503, if the 
selected client object is marked to be deleted, then the function loops to step 2501 to select 
the next client object, else the function continues at step 2504. In step 2504, the function 
invokes the function indicated by the passed parameter. In step 2505, the function sets the 
selected client object to active which indicates that client has already processed a message 
and knows the state of the resource and then loops to step 2501 to select the next client 
object. The function allows client objects to be added while processing. The function sets a 
didProcess flag in each client object as it invokes the function. The function loops through 
the client list until it detects that the function for all the client objects have been invoked. 
Upon completion, the function clears all the didProcess flags for when it is next invoked. 

Figure 26 is a flow diagram of an example implementation of the ResRef::up 
function. This function is invoked by the directory object to indicate that the resource is now 
up. In step 2601, the function places an up event on the queue by invoking the 
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sendEventAndProcess function and then returns. The ResRef::down function operates in an 
analogous manner. 

Figure 27 is a flow diagram of an example implementation of the ResRef::add 
function. This function is passed a client object and adds that client object to the client list 
5 of this resource reference object. In step 2701, the function adds the passed client object to 
the client list. In step 2702, the function sets the client object to point to this resource 
reference object. 

itsk Figure 28 is a flow diagram of an example implementation of the 

; 3 ResRef::goingAway function. The function is passed a client object. In step 2801, the 
I'D 10 function invokes the AddRef function of this resource reference object to indicate that the 
= S function is accessing this object. In step 2802, the function removes the passed client object 

US 

j from the client list. In step 2803, the function invokes the goingAway function of the 
L directory object to notify the directory object that this reference resource object is going 

away. In step 2804, the function invokes the Release function of the resource reference 
1-3 15 object and then returns. If another thread is currently processing messages from the queue, 
= 3 then this resource reference object cannot yet be deleted and the function marks the passed 

client object to be deleted and returns a failure indicator. 

Figure 29 is a flow diagram of an example implementation of the 
ResRef::getRefCountedPtr function. This function returns a reference counted pointer to the 
20 resource. In step 2901, if the resource reference object points to a resource, then the function 
continues at step 2902, else the function returns. In step 2902, the function reference counts 
the resource by invoking the AddRef function of the resource and then returns the referenced 
counted pointer. 

Figure 30 is a flow diagram of an example implementation of the 
25 ResRef:: delete Yourself function. In step 3001, the function removes this resource reference 
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object from the resource reference list of the directory object. In step 3002, the function 
reference counts the resource reference object by invoking the AddRef function. In steps 
3003-3005, the function loops selecting each client object in the client list and requesting 
that they delete themselves. In step 3003, the function selects the next client object in the 
client list. In step 3004, if all the client objects have already been selected, then the function 
releases the resource reference object by invoking the release function in step 3006 and then 
returns, else the function continues at step 3005. In step 3005, the function requests the 
selected client object to delete itself by invoking the delete Your self function and then loops 
to step 3003 to select the next client object. 

C. Client Object 

aire 31-34 are flow diagrams illustrating the processing of the functions of 
the client object, ^imire 3 1 is a flow diagram of an example implementation of the 
^ Client: :resIsUp function.^^is function is invoked when the resource comes up. In 

□ step 3101, the function sets the interface pointer of this client object to null. In step 3102, 

\S\. 

ru 15 the function retrieves a reference cotHrted pointer to the resource by invoking the 
^ getRefCountedPtr function of the resource reference object and saves it in a smart pointer. 
~ In step 3103, if the client object has an interfac^udentifier specified, then the function 
continues at step 3104, else the function continues at step^lOS. In step 3105, the function 
retrieves a pointer to the interface by invoking the query intCTf^ce function of the resource. 
20 In step 3 105, the function notifies the client derivation that the^e^source is now up by 
invoking the resourcelsUp function provided by the client. The function m&n returns. 

Figure 32 is a flow diagram of an example implementation of the 
Client: :resIsDown function. This function is invoked when a resource goes down. In 
step 3201, the function sets the pointer to the resource for this client object to null. In 
25 step 3202, the function notifies the client that the resource is now down by invoking the 
resourcelsDown function provided by the client. The function then returns. 
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igure 33 is a flow diagram of an example implementation of the 
Client: :deleteYotHself function. This function is invoked when this client object is to be 
deleted. In step 3301s. the function clears the interface identifier of this client object. In 
step 3302, if this client N)bject has a reference to a resource reference object, then the 
5 function continues at step 33S3, else the function continues at step 3308. In step 3303, the 
function notifies the resource refe^nce object that this client is going away by invoking to be 
goingAway function. In step 3304/Sf the invocation is successful, then the function 
continues at step 3305, else the function continues at step 3306. In step 3305, the function 
decrements the reference count for in the resoiftee reference object and sets its pointer to 
^ 3 10 null. In step 3306, the function sets the delete flagof this client object to true. In the 
f y step 3307, if this client object has a reference to a resource reference object, then the 
j y function returns, else the function continues at step 3308?\Tn step 3308, the function 



i pj destructs this client object and returns. 



o 

in 

SI'S 



34 is a flow diagram of example implementation of the 




. j 15 ^Client: :resourceIsUp functionT'Thi&^^ction is provided by a client to specify client specific 

* ! t processing to be performed when a resourc^eoqies up. In step 3401, this function sets a 

^^^^^ 

Q resource is a flag for the client. The client also provides^aB^nalogous function for when a 
resource goes down. 

2. Watching a Resource 

20 Figures 35-44 are flow diagrams illustrating the example implementations of 

functions for watching a resource. 

A. Watch Resource Component 

FigureT3^9^e flow diagrams of functions of resource manager for watching 
a resource. Figure 35 is a flow dia^am^ofan example implementation of the ResourceUp 
25 function of the resource manager. The resourcem3itag^r invokes this function whenever a 
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resourcg^^that node is detected as being up. The resource manager may know that a 
^jjf resource is up bec5tts€^ controlled the creation of the resource at startup, because it 
q^V dynamically created the resoiu^fc^hen requested by another resource, or because another 
resource created that resource and register&kjie created resource with the resource manager. 
5 This function is passed a pointer to the resource tmtSi^now up. In step 3501, if the bus is 
up, then the function notifies the bus manager by involdng^the attach function of the bus 
manager passing the identification of the resource that is now up elseTke function returns. In 
step 3502, the function updates the local resource directory to indicate^tfi^ the passed 
resource is up. The function then returns. 



in 



= '1 



io Figure 36 is a flow diagram of an example implementation of the 

ResourceDown function of the resource manager. The resource manager invokes this 
function passing the identification of a resource that has gone down. In step 3601, if the bus 
is up, then the function notifies the bus manager by invoking the detach function of the bus 
q manager passing an indication of the resource that is now down, else the function returns. In 
gii jis step 3602, the function updates the local resource directory to indicate that the resource is no 



longer up. The function then returns. 

Figure 37 is a flow diagram of an example implementation of the 
Directory: :watchRes function. This function is implemented by the resource manager and is 
invoked by a client to notify the resource manager to start watching a resource. This 

20 function is passed the identification (e.g., name) of the resource. In steps 3701-3703, the 
function loops checking whether the client node is already watching that resource. In the 
step 3701, the function selects the next entry in the client watched resource table starting 
with the first. In step 3702, if all the entries have already been selected, then the function 
continues in step 3704, else the function continues at step 3703. In step 3703, if the selected 

25 entry indicates that the passed resource is already being watched by the same client, then the 
function returns an indication that a duplicate watch has been placed on this resource by the 
client, else the function loops to step 3701 to select the next entry. In step 3704, the function 
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updates the client watched resource table to indicate that the client is watching the resource. 
In step 3705, if the resource is already being watched by the client node (because of a watch 
placed on that resource by another client), then the function returns, else the function 
continues at step 3706. In step 3706, if the bus is up, then the function notifies the bus 
manager to start watching the resource by invoking the watchRes function of the bus 
manager passing the identification of the resource to be watched. The function then returns. 
The passed pointer is passed to the bus manager as a notification context. 

Figure 38 is a flow diagram of an example implementation of the 
Directory:: stop WatchingRes function. This function is implemented by the resource 
manager and is invoked by a client to notify the resource manager to stop watching a 
resource. The function is passed the identification of the resource. In steps 3801-3803, the 
function searches for an entry corresponding to the resource and client in the client watched 
resource table. In step 3801, the function selects the next entry in the client watched 
resource table starting with the first. In step 3802, if all the entries have already been 
selected, then the client is not watching the resource and the function returns an error, else 
the function continues at step 3803. In step 3803, if the selected entry corresponds to the 
watch on the resource for the client, then the function continues at step 3804, else the 
function loops to step 3803 to select the next entry. In step 3804, the function removes the 
selected entry from the client watched resource table to indicate that the client is no longer 
watching the resource. In step 3805, if other clients at that node are still watching the 
resource, then the function returns, else the function continues at step 3806. In step 3806, if 
the bus is up, then the function notifies the bus manager to stop watching the resource by 
invoking the stop WatchingRes function of the bus manager passing an indication of the 
resource. The function then returns. 

Figure 38A is a flow diagram of an example implementation of a 
watchResIsUp function of the resource manager. This function is invoked by the bus 
manager when a resource that is being watched comes up. This function is passed the 
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context of the resource that is now up. In step 38A01, the function locates the context for the 
resource that is now up. In step 38A02, the function invokes the resIsUp function of the 
directory object to notify the clients. The function then returns. 

Figure 39 is a flow diagram of an example implementation of the 
ClientProcessIsDown function of the resource manager. The resource manager invokes this 
function whenever it detects that a process at the client node has gone down. This function 
performs processing to indicate that each resource of the process is now down. The resource 
manager maintains a list of resources per process in a process/resource list. In step 3901, if 
the bus is up, then the function notifies the bus manager that the resources of the process are 
now down by invoking the detach function of the bus manager for each resource in the 
process, else the function returns. In step 3902, the function invokes the 
Directory:: stop WatchingRes function for each client within that process that was watching a 
resource as indicated by the client watched resource table. The function also updates its 
tables and returns then returns. 

B. Bus Manager 

Figures 40-44 are flow diagrams of functions of the bus manager. Figure 40 is 
a flow diagram of an example implementation of the attach function of the bus manager. The 
attach function is invoked by nodes to notify the bus manager that a resource located at that 
node is now up. This function is passed an identification of and a pointer to the resource. In 
step 4001, the function updates the resource directory to indicate that the identified resource 
is now up and stores a pointer to that resource. In step 4002, if this resource is being 
watched, then the function continues at step 4003, else the function returns. The function 
determines whether a resource is being watched by searching the watched resource table of 
the bus manager. In step 4003-4005, the function loops notifying the client nodes which are 
watching the resource that the resource is now up. In step 4003, the function selects the next 
watching node that is watching for that resource from the local watched resource table. In 
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step 4004, if all the watching nodes have already been selected, then the function returns, 
else the function continues at step 4005. In step 4005, the function notifies the selected 
watching node that the resource is now up by invoking the watchResIsUp function of the 
watching node. The function then loops to step 4003 to select the next watching node. 

Figure 41 is a flow diagram of an example implementation of the detach 
function of the bus manager. The detach function is invoked by nodes to notify the bus 
manager that a resource located at that node is now down. This function is passed an 
indication of the resource. In step 4101, the function updates the resource directory to 
indicate that the resource is no longer up and then returns. 

Figure 42 is a flow diagram of an example implementation of the watchRes 
function of the bus manager. This function is invoked by a client node and is passed the 
identification of the resource to be watched along with a pointer to an interface of the client 
node. The bus manager invokes the function watchResIsUp of the interface to notify the 
client node when the resource comes up. In step 4201, the function adds an entry to the local 
watched resource table for the passed resource and client node. In step 4202, if the resource 
is already up as indicated by the resource directory, then the function continues at step 4203, 
else the function returns. In step 4203, the function notifies the client node that the passed 
resource is up by invoking the watchResIsUp function of the client node passing the 
identification of and a pointer to the resource. The function then returns 

Figure 43 is a flow diagram of an example implementation of the 
stopWatchingRes function of the bus manager. A client node invokes this function to stop 
watching the passed resource. In step 4301, the function updates the watched resource table 
of the bus manager to indicate that the passed client node is not watching the passed 
resource. The function then returns. 
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Figure 44 is a flow diagram of example implementation of the nodelsDown 
function of the bus manager. The bus manager invokes this function whenever the bus 
manager detects that a node has gone down. In step 4401, the function invokes the detach 
function for each resource that was attached by the node that has gone down. In step 4402, 
5 the function invokes the stopWatchingRes function of the bus manager for all resources that 
were being watched by the node that has gone down. The function then returns. 

3. Monitoring a Resource 

Figure 45-52 are flow diagrams of example implementations of the functions of 

3 a client node and server node for monitoring a resource. 

3 

A. Client Node 

>ure 45 is a flow diagram of an example implementation of the 
Directory: :monitofcRes function. This function is implemented by the resource manager and 
3 is invoked by a client to start monitoring for the passed resource to go down. In step 4501, 

r* \ 

y the function uses the pa^ed resource to identify the server node (i.e., the node where the 
15 resource is located) for the resource. The function may use the query interface function of 
J the resource to retrieve a pointerto an interface for identifying the server node. The function 
also updates the monitor resource tafeJe for the resource and client so that the client can be 
notified when the resource goes down andySO that the server node can be re-notified if it goes 
down and comes up. In step 4502, if a coh^ection has already been established with the 
20 server node as indicated by the client connectionstoble, then the function continues at step 
4508, else the function continues at step 4503. InNtep 4503, the function establishes a 
connection with the server node by invoking the connectGlient function of the server node 
passing a pointer to an interface of the client node for receiving notifications and passing a 
client context for identifying this connection. The invocation rerams a server context. In 
25 step 4504, if an error is detected when invoking the connectClient funcfckm, then the function 
continues at step 4505, else the function continues at step 4506. In step 4^05, the function 
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Assumes that the is server node is down and performs the associated processing and then 
returns. In step 4506, 'the function updates the client connection table to indicate that a 
connection has now been Established with server node with the client and server context. In 

' step 4507, the function signals to start sending a client is alive message periodically to the 
server node. The sending of \he client is alive message may be considered to be one form of 
"leasing" a resource. In step 4508, the function invokes the monitor resource function of the 
server node passing the identification of the resource to be monitored. The function then 
[returns. 

Figure 46 is a flow diagram of example implementation of the 
Directory: .stopMonitoringRes function. This function is implemented by the resource 
manager and is invoked by a client to stop monitoring for the passed resource to go down. In 
step 4600, the function invokes the stop monitoring resource function of the server passing 
an identification of the resource. In the step 4601, the function updates the monitor resource 
table to indicate that the resource is no longer being monitored by the invoking client. In 
step 4602, if the client node is still monitoring a resource of the server node, then the 
function returns, else the function continues at step 4603. In step 4603, the function updates 
the client connection table to indicate that there is no longer a connection between the client 
node and the server node. In step 4604, the function signals to stop sending the client is alive 
message to the server node. When the server node does not receive this message during the 
next time period, the server node will update its server connection table to indicate that there 
is longer a connection. The function then returns. 

Figure 46A is a flow diagram of an example implementation of a 
processServerlsDown function. This function is invoked when the client node detects that a 
server node is down. In step 46A01, the function removes an entry for the server node from 
the client connection table to indicate that there is no longer a connection established with 
that server node. In steps 46A02-46A05, the function loops notifying clients that are 
monitoring a resource on the server node that the resource has gone down. In step 46A02, 
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the function selects the next resource of the server node. In step 46A03, if all resources have 
already been selected, then the function returns, else the function continues at step 46A04. 
In step 46A04, the function invokes the resIsDown function of the directory object. In step 
46A05, the function removes resource entry from the client monitor resource table. The 
function then loops to step 46A02 to select the next resource. 

Figure 47 is a flow diagram of an example implementation of a resIsDown 
function of the resource manager. This function is invoked by a server node to notify the 
resource manager that a resource that is being monitored has gone down. In step 4701, the 
function invokes the resIsDown function of the directory object to notify the monitoring 
clients and then returns. 

B. Server Node 

Figure 48 is a flow diagram of an example implementation of a connectClient 
function of a server node. A client node invokes this function when it wants to start 
monitoring resources at the server node. This function is passed a pointer to an interface of 
the client node which can be invoked by the server node to notify the client node when a 
resource has gone down. The function is also passed a client context that identifies this 
connection for the client. The function returns a server context. The combination of client 
context and server context uniquely identifies the connection. In step 4801, if the client node 
has a connection currently established with the server node as indicated by the server 
connection table, then the function continues at step 4802, else the function continues at step 
4803. The server node may have missed a message that indicated that the client node had 
previously gone down. In step 4802, the function performs the processing to indicate that the 
client node has gone down and then returns an error to the client node. When the client node 
receives this error message, it will again try to re-establish the connection and this time the 
server node will recognize that no connection is currently established. In step 4803, the 
function updates the server connection table to indicate that a connection is currently 
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established between the server node and client node and that the connection is identified by 
the server context and client context. The function then returns the server context to the 
client node. 



Figure 48A is a flow diagram of an example implementation of the monitor 
5 resource function of the server node. This function is passed an identification of the 
resource, an identification of the client node, and the current connection context for the 
connection between the client and server nodes. In step 48A01, if a connection is currently 
established with the client node, then the function continues at step 48A02, else the function 
p returns are an error. In step 48A02, the function adds an entry indicating that the client node 
j '] 10 is monitoring the resource to the monitoring node table. In step 48A03, if the resource is 
j * currently up, then the function returns, else the function continues at step 48A04. In step 
; ? 48A04, the function removes the entry that was just added from the monitoring node table. 
Sj In step 48A05, the routine invokes the resource is down function of the client node passing 
13 an indication of the resource. In step 48A06, if an error was detected in notifying the client 
III; 15 node that the resources down, then the function continues at step 48A07, else the function 
returns. In step 48A07, the function assumes that the client node is down and performs the 
O appropriate processing. The function then returns. 

Figure 48B is a flow diagram of an example implementation of the stop 
monitoring resource function of the server node. The function is passed an identification of a 

20 resource and the current connection context for the connection between the client and server 
nodes. In step 48B01, if a connection is currently established with the client node, then the 
function continues at step 48B02, else the function returns an error. In step 48B02, if there is 
an entry in the monitoring node table corresponding to the monitoring of this resource by the 
client node, then the function continues at step 48B03, else the function returns an error. In 

25 step 48B03, the function removes the entry from the monitoring node table and then returns. 
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Figure 49 is a flow diagram of example implementation of the clientlsAlive 
function of a server node. This function is invoked by a client node and is passed the 
identification of the connection, that is a combination of client context and server context. In 
step 4901, if the client is in the client table, then the function resets the keep alive timer for 
5 that client and returns, else the function continues at step 4902. In step 4902, the function 
assumes that in the client node has gone down and returns an error message to the client 
node. 

Figure 50 is a flow diagram of an example implementation of the resIsDown 
^ function of a server node. This function is invoked when it is detected that a resource has 

S3. 

j io gone down at the server node. This function notifies each client node that has requested to 

^ monitor that resource. In step 5001, the function selects the next client node from the 

■jjj monitoring node table that is monitoring that resource. In step 5002, if all the client nodes 

J have already been selected, then the function returns, else the function continues at step 

3 5003. In step 5003, the function invokes the resIsDown function of the client node using the 

n 

lijis pointer to the client node stored in the server connection table passing the identification of 

% the resource that is now down. In step 5004, if an error is detected in the invocation, then the 

: si? 

3 function continues at step 5005, else the function loops to step 5001 to select next client 
node. In step 5005, the function assumes that the selected client node has gone down and 
updates the server connection table and the monitoring node table and simulates that it 
20 received a resource is down message for each resource on the client node that is being 
maintained by the server node and loops to step 5001 to select the next client node. 

Figure 51 is a flow diagram of an example implementation of a 
noKeepAliveReceived function of the server node. This function is invoked when the server 
node detects that no keep alive message has been received from a certain client within the 
25 time. In step 5101, the function assumes that the client has gone down and updates the 
server connection table for that client. The function then returns. 
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Figure 52 is a flow diagram of an example implementation of the 
processClientlsDown function of a server node. In step 5301, the function removes the entry 
for the client connection from the server connection table. The function then returns. 

v 4. Property Notifications 

5 ^he^ttacking system also provides for watching the properties of server 

resource by a client resource. A property of a resource corresponds to data related to the 
resource whose value can Qb^set by that resource during execution of a function of the 
resource. That function can be involved by another software component. The function may 
3 be specifically provided to set the value of^he property (e.g., a set property function) or may 

J 10 set the value of the property as a side effeaXJn one embodiment, a property watching 

y 

y . component of the resource tracking system allows cheat resources to register their interest in 

'fj receiving notifications when a property of a server resourcfesjs set. The client resources also 

'"' 4 specify the behavior to be performed when the property is sbt The property watching 

3 component provides a synchronous mechanism for notifying cliehk resources when the 

yi5 property is set. This synchronous mechanism ensures that client resources who are 

0 \ 

g registered to watch a property are notified of the setting of the property beihre any client 

resources are notified of a subsequent setting of the property. The property\watching 

component thus provides a mechanism for synchronizing processing among multiple\lient 

resources. 

20 Figure 53 is a block diagram illustrating the communications between a server 

resource and a client resource when watching a property. When a client resource wants to 
watch a property of a server resource, the client resource registers to track the server resource 
as described above. When the server resource enters the up state, the client resource can 
then register to watch a property of the server resource. The client resource invokes a watch 

25 property function of the server resource passing the name of the property to be watched, an 
identification of the client resource, and a context of the client resource that uniquely 
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identifies that property to the client resource. When the property of the server resource is 
set, the server resource invokes a property set function of the client resource passing the 
context received from the client resource and passing the value of the property. The property 
set function of the client resource can then use the context to identify the property and 
perform the behavior specified when the client resource specified its interests in watching the 
property. When the client resource no longer needs to watch the property, the client resource 
invokes the stop watching property function of the server resource. The server resource 
registers to monitor each of its client resources so that when a client resource goes down, the 
server resource receives a resource is down notification. Upon receiving such a notification, 
the server resource stops notifying the client resource when the property is set. In one 
embodiment, a client node may cache property values so requests to get the value of that 
property can be satisfied locally. 

Figure 54 is a block diagram of the components to support the watching of 
properties by a client resource. In one embodiment, the property watching component of a 
client resource uses the directory object 5401, resource reference object 5402, and client 
object 5403 data structures that are used for tracking a resource. When a property of a server 
resource is being watched, a special type of client object is added to the list of client objects 
of the resource reference object for that server resource. The special type of client object 
indicates that it represents the watching of a certain property and includes a property 
reference object 5404 for each time that the client resource has registered to watch that 
property. Each property reference object has a function that is to be invoked when the 
property is set to notify the client resource. The context/client table 5405 contains an entry 
for each property of a server resource that is being watched by that client resource. Each 
entry contains a context and a property client indicator. The context uniquely identifies the 
server resource and property within the client resource, and the property client indicator 
points to the corresponding property client object. A client resource also includes a 
synchronize property function 5406 and a property set function 5407. The synchronize 
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property fimction is invoked by the server resource when a client resource first registers to 
watch a certain property of that server resource to provide the current value of the property to 
the client resource. The property set function is invoked whenever a watched property is set. 
These functions are passed the context and the property value and perform the behaviors 
5 registered by the client resource. 

Figure 55 is a block diagram illustrating the components to support the 
watching of properties of a server resource. The server resource 5501 includes a 
property/client table 5502. The property/client table contains an entry for each property of 
the server resource that is being watched. Each entry contains the name of the property, the 

10 value for that property, and a client watching object 5503 for each client resource that has 
registered to watch that property. Each entry may also include a queue for storing property 
values in the order in which they are set pending notification of each of the client resources. 
The server resource also includes a watch property function 5504 and a stop watching 
property function 5505. The watch property function is passed an indication of a property of 

15 the server resource, the identification of the client resource, and a context. The watch 
property function adds a client watching property object in the property/client table to 
indicate that the client resource is now watching the property. The watch property function 
also requests that the client resource to be monitored using a monitoring component 5506. 




[Add MariRestsB^iiBlock to Figure] 



20 Figure 56 is a flow diagram of an exarr^TeTinplementation of the watch 

property fimction of the server resource. This function is passed the name of a property, a 
reference to the client resource requesting to watch the property, and a context used to 
identify the watch within the client resource. In step 5601, if the server resource is already 
monitoring the client resource, the function continues at step 5603, else the function 

25 continues at step 5602. In step 5602, the function invokes the register resource function 
passing an indication of the client resource to register for tracking the client resource and 
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receiving in return a handle for identifying that registration. In general, a server resource will 
only receive one watch property invocation for each property that a client resource registers 
an interest. The monitoring of the client resource may be performed using the watching and 
monitoring components of the resource tracking system as described above or may be 
5 performed using a monitoring component that is adapted for specifically monitoring client 
resources that are watching a property. In step 5603, the function adds an entry into the 
property/client table for the client. In step 5604, the function retrieves the property value for 
that property. In step 5605, the function invokes the synchronize property function of the 
client resource passing the context and the retrieved property value. The function then 

" J io returns. 

,3 

>y 

.f| Figure 57 is a flow diagram of an example implementation of the stop watching 

j: property function of the server resource. This function is passed the name of a property and 

'-4 an indication of the client resource. In step 5701, the function removes the client watching 

;3 object for that client resource for that property from the property/client table. In step 5702, if 

[j 15 the property/client table contains no more client watching objects for that client resource, 

S then the function continues at step 5703, else the function returns. In step 5703, the function 

- J invokes the unregister resource function to stop monitoring that client resource. The function 
then returns. 



Figure 58 is a flow diagram of an example implementation of the monitor 
20 resource is down function of the server resource. This function is passed the identification of 
the client resource that is down. In step 5801, the function removes all client watching 
objects for the client resource from the property/client table. In step 5802, the function 
unregisters monitoring of that client resource and then returns. 

Figure 59 is a flow diagram of an example implementation of the set property 
25 function of the server resource. The set property function of the server resource is passed the 
name of the property and a value. This function adds the property value to a queue for that 
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property and then processes the values in the queue to notify the client resources. In step 
5901, the function updates the property value in the property/client table and adds the 
property value to the queue for that property. In step 5902, if that property queue is being 
processed to by another thread, then the function returns, else the function continues at step 
5 5903. In step 5903, the function sets a property queue is being processed flag to indicate that 
this thread will begin processing the queue for this property. In step 5904, the function 
invokes the process queue function to process the queue for this property. In step 5905, the 
function clears the property queue is being processed flag and then returns. In one 
embodiment, each property has an object associated with it that provides the functions and 
3 10 data structures for managing and processing the queue. 

,fj Figure 60 is a flow diagram of the process queue function. The process queue 

= 

~ function loops selecting each value in the queue for a property and notifying each client 
'4 resource that is watching that property. In step 6001, the function selects the next value in 
3 the property queue. In step 6002, if the queue is empty, then the function returns, else the 
yi5 function continues at step 6003. In steps 6003-6007, the function loops notifying each client 
: 'i resource who is watching the property. In step 6003, the function selects the next client 
J resource of the property as indicated by the client watching objects. In step 6004, if all the 
client resources have already been selected, the function loops to step 6001 to select the next 
value in the property queue. In step 6005, the function invokes the property set function of 
20 the selected client resource passing the context and the value for the property. This function 
is a synchronous invocation so that it does not return until the client resource performs its 
behaviors associated with this property. In step 6006, if an error is returned, then the client 
resource is assumed to be down and the function continues at step 6007, else the function 
loops to step 6003 to select the next client resource of the property. In step 6007, the 
25 function invokes the monitor resource is down function passing the client resource and then 
loops to step 6003 to select the next client resource of the property. 
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;ure 61 is a flow diagram of an example implementation of a register watch 
function of a clientsresource. This function is passed the identification of the server resource, 
the name of the propehv to be watched, and identification of the client resource. In step 
6101, if the client resource lfcsdready watching that property, then the function continues at 
5 step 6106, else the function coiufemes at step 6102. In step 6102, the function creates a 
unique context for the client resource wd property. In step 6102, the function invokes the 
watch property function of the server resoiftQe passing the name of the property and the 
context. In step 6104, the function creates a prop^v client object for that property and adds 
that object to the client object list of the resource reference object for that resource. In step 
10 6105, the function adds an entry to the context/property tabfes s In step 6106, function adds a 
property reference object to the list associated with the proper^ client object and then 
returns. 

Figure 62 is a flow diagram of an example implementation of the property set 
function of the client resource. This function is passed a context and a property value. In 
15 step 6001, the function retrieves the pointer to the property client object from the 
context/client table using the passed context. In step 6202-6204, the function loops invoking 
* the behavior associated with each property reference object for that property client object. In 
step 6202, the function selects the next property reference object starting with the first. In 
step 6203, if all the property reference objects have already been selected, then the function 
20 returns, else the function continues at step 6004. In step 6004, the function invokes the value 
set function of the property reference object to notify the client resource that the property has 
been set. The function then loops to step 6202 to select the next property reference object. 



Event system 

The evenTsystena^rovides a mechanism for providing event notifications when 
25 ^events are generated by resources. AneVentosan asynchronous signal that is distributed to 
all client resources, also referred to as listeners, wholiaA^eregistered to listen for an event 




[30581 -8002/Application.doc] 



S*«3 



52 

jjgnal. In one embodiment, the event system neither guarantees that a listener will receive 
the events in the order they are generated nor guarantees that each listener will receive every 
event for wh^ch it is listening. Each event has an associated event type. A listener registers 
to listen for eveht^ of a certain event type. In one embodiment, the event types may be 
hierarchically organizeSssFor example, one event type may be a timer event. The timer 
events may be further classnfcd into catastrophic timer events, warning timer events, and 
informational timer events, which a*^, sub-events. An informational timer event may further 
be classified into start-up timer events ahd shut-down timer events. A listener may register 
to listen for events at any level in the event hi&^rchy. For example, a listener may register to 
listen for informational timer events. That listener wmild receive an event notification as for 
start-up timer events and a shut-down timer eventsN. A listener will receive event 
notifications for leaf events of the sub-tree correspond to theS^nt type registered. A leaf 
event is in event that is not further classified into sub-events. An e^ent type may have its 
hierarchy embedded in its name. For example, the name of start-up tnh^r event may be 
"/timer event/informational time event/start-up timer event." ^ N v. 

aire 63 is a block diagram illustrating components of the event system in one 
Embodiment. A cnfent 6301 registers to listen for events by sending a listen message along 
with an event type to the listener component 6303. The client receives from the listener 
component an event notify message along with event information when an event of that event 
type is generated. The client un-registers its interest in listening for events of a certain event 
type by sending a stop listening message^^ong with the event type to the listener component. 
In one embodiment, each node as a listener ^smnponent through which is routed all event- 
related messages for all listeners on that node. Tte listener component may in turn route 
event-related messages to a listener bus manager 6305>The listener component notifies the 
listener bus manager to listen for all event types for whibh listeners on that node have 
registered. The listener component may send only the listenerlms manager. One listen 
message for each event type regardless of how many listeners at that noste have registered for 
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th^t event type. For example, if a listener component receives requests from six clients, the 

listenei\component sends only one listen message to the listener bus manager. The listener 

componen^maintains a listener table cache 6306 that contains a mapping from each event 

type for whicft^ilisten request has been registered and each client that has registered for that 

5 event type. WhenN^he listener component receives an event notification, it uses the listener 

table cache to notify ^ch listener that has registered for that event type. In this way, the 

listener component reduces^fre event messages that are sent between that node and the node 

of the listener bus manager. >ft(hen the listener component receives event notifications, it 

queues an event notifications for e&ch listeners. The listener component uses a separate 

*3 10 thread for providing the event notification to each listener. If a single thread were used to 

S: J notify each listener, the event notifications cbuld be delayed to some listeners as a result of a 

j y delay or problem in notifying another listener. TJje use of a separate thread for each listener 

ensures that the notification to one listener will mrt be delayed as a result of an event 

notification to another listener. The listener component may receive a bus state change 

P 15 message. If the bus goes down and then comes back ujvsthe listener component can re- 
in \ 

! U register with the listener bus manager to receive the events of tte event types in its listener 
h 3 table cache. The listener component may also optimize its sending of listen requests based 
on the event hierarchy. For example, if a listener registers to listen for^ informational timer, 
the listener component will register that request with the listener bus meager. If another 
20 listener registers to listen for a start-up timer, then the listener component wiU not need to 
register that request with the listener bus manager. Since the listener componentims already 
registered to receive a higher-level event type, it is already registered to receive aXtower- 
level event types. 

The listener bus manager maintains a listener table 6307. The listener table 
25 contains a mapping from each event type to the registering nodes. When the listener bus 
manager receives an event posting, it notifies each node who has registered to listen for 
events of that event type and any event type that is a parent event type. The listener bus 
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manager queues event notifications in a manner that is similar to the queuing performed by 
the listener component. In particular, the listener bus manager allocates a different thread for 
each node to which an event notification is sent so that the event notifications to other nodes 
are not delayed because of problems in notifying one node. The listener bus manager may 
5 receive a node is down message and remove the entries from the listener table for that node 
so that no more event notifications will be sent to that node. A server 6302 may generate and 
post events by sending a post event message to the listener bus manager. The post event 
message includes event information that describes the event. The event information may 
include the event type, a time associated with the event, an indication of who generated the 
10 event, and the reason the event was generated. 

y 

6. Logging System 

rii 

; ~ All log records are classified using an ASN. 1 Object Id. 

Standard Log record ASN. 1 Type Classification: 



n 

I S is l.x - All log records 

|[j l.x.O - NonCritical 

i;3 l.x.0.0 - Trace output 

l.x.O. 1 - Progress 

l.x.l - Error 

20 l.x.2 - Warning 



Log records are composed of four fields of information: type, time, creator, 
information. Type and time are ASN.l ids while the creator can be either an ASN.l 
HcsResource instance id or a text string. The information field is the actual text generated 
by the logging component. 

5> c Thc arc various coinpTOretltS" in tne^yst^ responsible" 

collecting, storage, and possibleJbFwardiirg"3no^ All forms of this component are 

j yfhe Hc s LogF a c itrty-efass^ 
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HcsLogFacility class 




s^j£> w ' The HcsLogFacility class^s^iiJi csResource derivatio ns-JwiiQ^s-^ttfixysg"T5^to 

provide storage and fony^di»g--«t^anblislevels in the system. There are currently two 
mplemejjlatrSnsT the Local Log Facility, and the Central Log Facility. The HcsLogFacility 



terrace is: 



( 0$C>O . 
i \ 
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class HcsLogFacility : public HcsResource 
public: 



virtual HRESULT putRecord ( char* typeAsnlldStrPtr, 

char* timeAsnlStrPtr, 
char* idStrPtr, 
char* recordPtr ) = 0; 



The Local Log Facility 



Local Log Facility (LLF) instance (only one!) exists in every node in the 
"system. The purpose of this HcsLogFacility implementation is to accept all log records from 
various HCS component&son that node and to buffer them in a large circular on disk until 
they can be delivered to the ^Jentral Log Facility (CLF). The intent is that a node could 
survive for some time if the CKF were to be unavailable. One of the configuration 
parameters passed to each Local HcsbogFacility instance will be the resource name of the 
HcsLogFacility through which that instances to forward its records. The current thinking is 
that this will be the name of the CLF but this^s not an architectural requirement. In other 
words there could be intermediate levels of HcsLogEacilities placed in the system. In fact on 
LLF could be configured to forward its records to anotherJXF. After all a HcsLogFacility is 
30 a HcsLogFacility. 
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The Central Log Facility 



There will be one instance of the Central Log Facility (CLF) instance in the 
entire system. The purpose of this HcsLogFacility implementation is to accept all log 
records from various HCS components within the entire system and to provide for the final 
storage of this information. The intent is that this facility provide for the long term, off line, 
archival of the entire HCS system log. In addition to this function, it will also provide for the 
on-line viewing of some portion of the log. 




How log records are written 



the question is: how do HCS components log there information? To 



y x V provide a standard 



$afe access to the HcsLogFacilities, there is a class family provided. 
The family is based at a cla^s called HcsLogPort. This class implements the common 
behavior of all types of LogPorts att&is functional on its own. 



y 




"Derived — fro m — the — HcsLogPort — afe — the — HesResoiffceLogPort^aftd- 



csLogFacilityPort classes. The HcsResourceLogEoi^praddeeasy support for the resource 
3 15 developer while the HcsLogl^eiftty^^ direct access to HcsLogFacilities. In 

general, theJii^S'use^ Resource derivations while the second would be used by resource 
tHystem^emponents^ 




20 { 
25 



class HcsLogPort 
public: 

/* Global Constant AsnObjectlds for all defined log record types 
SEE INCLUDE FOR TYPE LIST */ 
#include <HcsLogRecTypes.h> 



public: 



30 



HcsLogPort ( char* idStrPtr ) ; 
virtual -HcsLogPort ( void ); 

void put ( const AsnlObjectld* typePtr, char* formatStrPtr, .. 
inline char* getldStrPtr ( void ) { return( myldStrPtr ); }; 



); 
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BOOL setldStr ( char* newIdStrPtr ); 

/* Methods to control log filtering */ 
void enable ( char* asnlldOfLogRecTypeToEnablePtr ); 
void disable ( char* asnlldOfLogRecTypeToDisablePtr ); 
BOOL isEnabled ( char* asnlldOfLogRecTypeToChkPtr ); 
BOOL isEnabled ( const AsnlObjectld* logRecTypeToChkPtr ); 
inline HRESULT dumpFilterState ( TextSink* toSinkPtr, int 
maxLineSize ) 

{ return( my Filter. dumpState( toSinkPtr ) ); }; 
inline void resetFilter ( void ) { myFilter.resetQ; }; 



void forwardRec ( const AsnlObjectld* typePtr, char* timeAsnlStrPtr, 
char* idStrPtr, char* recordPtr ) ; 

/* used to forward from one 
HcsLogPort implementation to another */ 



protected: 

/* Derivation Interface */ 

/* Defaults to writing errors only to the NT SystemLog */ 
virtual void dumpRec( const AsnlObjectld* typePtr, char* 
timeAsnlStrPtr, char* idStrPtr, char* recordPtr ) ; 



private: 

void putOver ( void ) ; 

HcsLogPort ( void ) ; 

void* operator new ( size t size ) ; 



private: 

char* 
HANDLE 
DWORD 
AsnlSet 



myldStrPtr; 

my Handle; 

myldEvent; 

myFilter; 



public: 

/* Grand fathered Methods */ 
void setTrace ( BOOL to ); 
void setProgress ( BOOL to ); 
void setWarning ( BOOL to ); 
BOOL isTraceEnabled ( void ); 
BOOL isProgressEnabled ( void ); 
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BOOL isWarningEnabled ( void ); 
void putError ( char* formatStrPtr, ... ) ; 
void putWarning ( char* formatStrPtr, ... ) ; 
void putTrace ( char* formatStrPtr, .. . ) ; 
void putProgress ( char* formatStrPtr, ... ) ; 
void putMaintFailure ( char* formatStrPtr, ... ) ; 



/* class used by resource implementors */ 
class HcsResourceLogPort : public HcsLogPort 

public: 

HcsResourceLogPort ( HcsResourcelmp* ownerPtr, char* idStrPtr ); 
virtual -HcsResourceLogPort ( void ); 



protected: 

/* routes all output through the owning HcsResourcelmp's 
putLogRecord private support method */ 

void dumpRec( char* typeAsnl IdStrPtr, char* timeAsnlStrPtr, char* 
idStrPtr, char* recordPtr ); 



private: 

HcsResourceLogPort ( void ); 
void* operator new ( sizet size ); 

}; 



/* class used by non resource centric implementations */ 
class HcsLogFacilityPort : public HcsLogPort 

public: 

HcsLogFacilityPort ( char* idStrPtr ); 

HcsLogFacilityPort ( HcsLogFacility* facilityPtr, char* idStrPtr ); 

HRESULT setFacility ( HcsLogFacility* facilityPtr ); 

HRESULT clearFacility ( void ); 

BOOL isFacilitySet ( void ); 
inline BOOL isTapped ( void ) { return( mylsTapped ); }; 
inline void setTapOn ( void ) { mylsTapped = TRUE; }; 
inline void setTapOff ( void ) { mylsTapped = FALSE; }; 

virtual -HcsLogFacilityPort ( void ); 
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protected: 

/* defaults to writing errors only to the NT SystemLog (chicago??) 
unless an HcsLogFacility is made available 
and is functioning */ 

void dumpRec ( const AsnlObjectld* typePtr, char* timeAsnlStrPtr, 
char* idStrPtr, char* recordPtr ) ; 

private: 

HcsLogFacilityPort ( void ) ; 

void* operator new ( size t size ) ; 
private: 

HcsLogFacilityOlePtr myFacOlePtr; 
BOOL mylsFacSet; 
BOOL mylsTapped; 



Effects on the HcsResourcelmp Interface 




^ffcsKesourcelmp: :putEogRecord — implementation: keeps and injs 
csLogFacilityPort instance which is used to forward records-4hroGgE! Before a record is 
actually forwarded, HcsResowcehi^checks to make sure an HcsLogFacility has been assign 
to its port. If thisjs^netthe case, an attempt is made to locate the local HcsLogFacility for 
that node^via the HcsResrcBusIf::locateLocalResourceById method (new). In any case, the 



le via the resource instances HcsLogFacifi^^rt^ 



New: The HcsResource interface defines, and the HcsResourcelmp 
implements, two methods: 



HRESULT enableLogging ( [in, string]char* forLogRecClassPtr ); 
HRESULT disableLogging ( [in, string]char* forLogRecClassPtr ); 

These are used by support to enable and disable logging dynamically within 
instances of HcsResources. 
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The HcsLogFacility class and HcsLogFacilityPorts 



Notice that any HcsLogFacility can be referenced by a HcsLogFacilityPort. 
This means that some components may wish to connect directly to the CLF. A good 
example of this may be the Resource Bus Manager (RBMGR.EXE). 

Although specific embodiments of, and examples for, the present invention are 
described herein for illustrative purposes, it is not intended that the invention be limited to 
these embodiments. Equivalent methods, structures, processes, steps and other modifications 
within the spirit of the invention fall within the scope of the invention. Accordingly, the 
invention is not limited to the specific embodiments, but instead the scope of an invention is 
specified by the following claims. 
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